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<N ■ Abstract 

> ■ 

■<^j- ' We consider controllability for divergence-free systems that have a conserved 

, quantity and satisfy a Hormander condition. It is shown that such systems are con- 

■ trollable, provided that the conserved quantity is a proper function. The proof of 
the result combines analytic tools with probabilistic arguments. While this state- 
ment is well-known in geometric control theory, the probabilistic proof given in 

f^*) , this note seems to be new. We show that controllability follows from Hormander's 

**^ ■ condition, together with the a priori knowledge of an invariant measure with full 

topological support for a diffusion that 'implements' the control system. 
Examples are given that illustrate the relevance of the assumptions required for 
the result to hold. Applications of the result to ergodicity questions for systems 

■ arising from non-equilibrium statistical mechanics and to the controllability of 
Galerkin approximations to the Euler equations are also given. 



1 Introduction 

In this note, we are interested in the controllability of systems of the form 

z = f{z) + u{t), z(t) e R N , (l.l) 

where f:R N ^R N is a smooth vector field and the control u is only allowed to 
take values in a given linear subspace E of R^. Our aim is to study the possibility, 
given a starting point z$ £ ~R N and a final point z\ G R^, of finding a control u 
taking values in the (possibly small) space E that allows to 'stir' the solution of 
(1.1) from zo into a small neighbourhood of z\. 

It is a well-known fact, see for example [Lob74] or [AS04, Chapter 3], that if 
this control system satisfies a Hormander condition and / is Poisson stable, then 
(1.1) is approximately controllable in the sense that for any two points zq and 
z\ in R N there exists a time T and a control u £ C°°([0, T], E) such that the 
solution z(T) of (1.1) at time T is equal to z\. In this note, we show that this 
fact can be shown as a consequence of the fact that (1.1) is equivalent to a control 
system such that the corresponding stochastic differential equation has the strong 
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Feller property and possesses an invariant measure with full topological support, 
see Proposition 3.5. In Section 4.5, we show how such an argument can be reversed 
in order to obtain the uniqueness of the invariant measure for an SDE where no 
invariant measure is known a priori, provided that it is equivalent in the sense of 
control systems to an SDE for which the invariant measure is known. This situation 
arises in non-equilibrium statistical mechanics, where a non-equilibrium system 
can be compared to the corresponding equilibrium system. 

In the case when / is a polynomial vector field of odd degree, it is known (see 
for example [JK85] and references therein) that Hormander's condition is both nec- 
essary and sufficient for the system (1.1) to be controllable. This is not the case in 
general. In Section 4.2, we provide an example of a non-controllable system which 
satisfies all of the conditions of the main theorem of the present article, except for 
the growth condition of the conserved quantity H. This illustrates the fact that the 
growth condition on H encodes global geometric information on / (Poincare recur- 
rence) that complements the local geometric information given by the Hormander 
condition and is essential to the result. Applications to the controllability of the Eu- 
ler equations and to an ergodicity problem coming from non-equilibrium statistical 
mechanics will be given in Sections 4.4 and 4.5. 

2 Setting 

We consider the controllability of systems that have a smooth conserved quantity 
called H, i.e. we assume throughout this paper that 

{VH(z), f(z)) = , Vz£R N . (2.1) 

We assume that the state space splits in a natural way as E ® E 1 - and we 
denote its elements by (x, y). We would like to stress the fact that even though 
our prime interest is Hamiltonian systems, the splitting under consideration is not 
necessarily the standard splitting in position and momentum variables. Typically, 
x would consist only of part of the momentum variables and y would consist of all 
the other variables of the system. In particular, we allow dim E ^ dim E^, which 
is actually the most interesting case in our situation. 

Our first assumption is that the flow generated by / preserves the Lebesgue 
measure and that it has a conserved quantity H: 

Assumption 1 The vector field f is divergence-free and there exists a smooth func- 
tion H: — > R such that (2.1) holds. 

Our second assumption ensures that H grows at infinity: 

Assumption 2 The level sets {z \ H(z) < K} are compact for every K > 0. 

Recall that, given a vector field / on R^, we can identify it with the corre- 
sponding differential operator J2i fi( x )d Xi - With this identification, the Lie bracket 
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between two vector fields is simply the vector field corresponding to the commu- 
tator of the two differential operators. The Lie algebra generated by a family of 
smooth vector fields is the smallest subspace of the space of all vector fields that is 
closed under the Lie bracket operation. 

We also introduce an extended phase space R Ar+1 , which includes time as an 
additional dimension, and extend / to a vector field / on R w+1 by setting f(x, t) = 
(/Or), 1). Our last assumption then essentially says that the differential operator 
dt + C* (with C* defined as in (3.3) below) is hypoelliptic, see [Hor85]. 

Assumption 3 Given a basis {e±, . . . ,e n } of E, the Lie algebra generated by 
{/, ej, . . . , e n } spans ~R N+l at every point. 

Note that the statement of Assumption 3 is actually independent of the partic- 
ular choice of the basis of E. With these notations, the main result of this article 
is: 

Theorem 2.1 Under assumptions 1-3, for every initial condition zq G and ev- 
ery terminal condition z\ G R^ there exists a time T and a control u G C°°([0, T] , E) 
such that the solution z(T) of (1.1) at time T is equal to Z\. 

3 Proof of the main result 

The main idea in the proof of Theorem 2. 1 is to consider the following Ito stochas- 
tic differential equation on R n : 

dm = /*(£, V) dt - (Zg'{H)e- 29(H) V x H) (£, rj) dt + v^e"^^ dw(t) , 
dv(t) = fyVi,V)dt, (3.1) 

where g: R + — > R is a function to be determined later. Here, w is an n-dimensional 
standard Wiener process. 

We will assume from now on that the function g is smooth, increasing, and that 
g(0) = 0. We will also assume that g grows sufficiently fast so that exp(— g o H) is 
integrable and we denote by Z the value of the integral. This can always be done 
thanks to Assumption 2. The following result is elementary: 

Lemma 3.1 Under the above assumptions, there exists a choice of function g 
such that (3.1) has a unique global strong solution for all times and such that 
^n(dx, dy) = Z^ 1 exp(— (g o H)(x, y)) dx dy is an invariant probability measure 
for (3.1). 

Proof. The existence of a unique local strong solution is a standard result for SDEs 
with smooth coefficients [0ksO3]. To show that this solution can be continued for 
all times, we show that there exists a suitable choice of g such that H, evaluated at 
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the solution to (3.1), grows at most exponentially fast. Using for any function h on 
the shortcut h s = h(£(s), ij(s)), Ito's formula yields 

H t = H + f ' e- 29( - H *\{A x H) s - mV x H) s \\ 2 g'{H s ))ds 
Jo 

+ V2 [ e- 9(H ^{(V x H) s ,dw(s)) . 
Jo 

Since H is smooth and proper, we can now chose for g an increasing function that 
tends to +00 sufficiently fast so that e~ 29( ~ Hix ' y) \A x H)(x, y) < C + H(x, y) for 
some constant C and for every (x, y) G R^. Using Gronwall's inequality, this 
ensures that 

EH t < H e l + C(e l - 1) , (3.2) 

for every t > 0. 

That hh is an invariant probability measure for (3.1) follows immediately from 
the fact that 

C* exp(-# oH) = 0, 
where C* is the adjoint of the generator of the semigroup generated by (3.1), 

CF = -V • (fF) + V x (V x H(g' o H)e~ 2 3 oH F) + V x (e~ 29 ° H V x F) . (3.3) 

See e.g. [Has80, 0ksO3, RY99] for more details. □ 

Note furthermore that the hypoellipticity assumption 3 implies that the transi- 
tion probabilities corresponding to the solutions of (3. 1) have a density with respect 
to Lebesgue measure that is smooth in all of its arguments (including time). This is 
an immediate consequence of the fact that the transition probabilities are a solution 
(in the sense of distributions) to the equation 

(d t + C*) Pt (z, z') = , 

and that dt + C* is hypoelliptic by Hormander's theorem (see [H6r85]). 

The result stated in Theorem 2.1 is now an almost immediate conclusion of the 
following two facts: 

1. The measure satisfies fin(A) > for every open set A C R^. 

2. The measure is the only invariant probability measure for (3.1) and is 
therefore ergodic. 

While the first claim is obvious, the second claim requires some more explanation. 
Surprisingly, it will turn out to be an almost immediate consequence of the first 
claim, once we realise that the hypoellipticity assumption 3 implies the following. 

Lemma 3.2 Fix a time t > and denote by ~Pt(z, ■ ) the transition probabilities 
corresponding to (3.1 ). Then, they are continuous in the total variation topology. 
In particular, for every z 6 R^, there exists 5 Z > such that 

\\V t (z,-)- W,-)||tv < 1. 
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for every z' such that \z' — z\ < 5 Z . Here, \\ ■ ||tv denotes the total variation 
distance between probability measures ( normalised in such a way that the distance 
between two mutually singular probability measures is 2 ). 

Proof. This is an immediate consequence of the smoothness of the transition prob- 
abilities. □ 

Recall that the topological support supp n of a probability measure /x is the 
smallest closed set of full ^-measure. Equivalently, it is characterised as the set 
of points z such that every neighbourhood of z has positive /^-measure. As an 
immediate consequence of Lemma 3.2 and the fact that distinct ergodic invariant 
measures are mutually singular we have 

Corollary 3.3 For every z £ there exists 5 Z such that at most one ergodic 
invariant probability measure \i z for (3.1) that satisfies supp fi z n B(z, 5 Z ) ^ (f). 
Here B(z, 5) denotes the open ball of radius 5 centred in z. 

It follows from Corollary 3.3 that the set of all ergodic invariant measures for 
(3.1) is countable. Denote this set by {fii}i>o and define Si = supp fii. An impor- 
tant property of the 5^'s which follows immediately from Corollary 3.3 is 

Corollary 3.4 Every compact region ofR N intersects at most finitely many of the 
Si's. 

Since every invariant measure for (3.1) is a convex combination of ergodic 
invariant measures, there exist weights pi with p -i > and J2 Pi = 1 sucn that 
[iH = YliiVil^i- It follows from Corollary 3.4 that 

supp^ = [j{Si \pi / 0} . 

Since the Si's are disjoint closed sets satisfying Corollary 3.4, the only way in 
which they can cover is by having only one ergodic invariant measure with 
support R^. We have thus shown that \in is the only invariant probability measure 
for (3.1) and as a consequence is ergodic. 
Let us now turn to the 

Proof of Theorem!. 1. Fix an arbitrary open set A C R^ and denote by B the 
set of all points zq in ~R N such that there exists a time T and a smooth control 
u G C°°([0, T], E) such that the solution of (1.1) with initial condition zq satisfies 
z(T) G A. Our aim is to show that B = ~R N , which then implies the statement of 
the theorem by [Jur97, Theorem 3.2]. 

Consider now the solution of (3.1) with initial condition (£o, %) = z & K N and 
define the stopping time T z = inf{t > | (£(i), rj(t)) £ A}. It follows immediately 
from Birkhoff 's ergodic theorem and the fact that [ih(A) > that the set 

B = {z G R N | P(T Z < oo) = 1} 
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satisfies ph(Bq) = 1, so that Bq is dense in R . Furthermore, a consequence of 
Lemma 3.2 is that if B(z, 5 Z ) C\ B$ ^ <p then P(T Z < oo) > \. Combining these 
two statements shows that for every z € ~R N there exists a time t > such that 
Vt(z, A) > 0. The support theorem [SV72], combined with the fact that the control 
problem associated to (3.1) is equivalent to (1.1) (since V X H takes values in E) 
allows us to conclude that B = K N . □ 

Retracing the argument of the proof, one sees that we have actually proven the 
following weaker fact: 

Proposition 3.5 Consider a control system of the form 

z = f(z) + A(z)u(t), (3.4) 

where z G R n , u is a smooth control taking values in R d , and A: R n — > R nxci . Jf 
the corresponding stochastic differential equation 

dz = f(z) dt + A(z) dw{t) , 

has the strong Feller property and possesses an invariant measure with full topo- 
logical support, then (3.4) is approximately controllable. 

4 Examples and applications 

In this section, we present a number of examples which explore to which extent 
the conditions formulated in this paper are necessary to the result. We also present 
a few applications in which our result may prove to be useful. 

4.1 Dropping the hypoellipticity assumption 

It is clear from [JK85] that Assumption 3 is crucial for any result of the type of 
Theorem 2.1, as can be seen from the following very easy example. Consider the 
Hamiltonian 

H _ Pl+P2 , Qi+qZ 
2 2 

and define / as the corresponding Hamiltonian vector field. If we define E to be 
the linear subspace of R 4 corresponding to the variable pi, it is clear that all of our 
assumptions are satisfied, except for Assumption 3. However, q| +P2 i s an integral 
of motion of this system that cannot be perturbed by acting on the variable p\ , so 
that the conclusion of Theorem 2.1 does not hold. 

4.2 Dropping the conservative structure or the growth condition on H 

Consider the control system in R 2 given by 



x = u{t)-x, y = g(y + g{x)) - yip(y) , (4.1) 
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where g: R — ► [— 1, 1] is an odd function with g'(x) > for all x and such that 
\\m x ^± 00 g(x) = ±1. The function <p: R — > [0, 1] is a smooth function such that 
tp(y) = for \y\ < 2 and ip(y) = 1 for |y| > 3. 

One can see immediately that, whatever the values of u and x are, one has y > 
for y G (1,2) and y < for y G (—2, —1). This shows that the conclusions of 
Theorem 2. 1 cannot hold in this situation. However, the system (4.1) is hypoelliptic 
since the commutator between d x and — xd x + g(y + g(x))d y — yip(y)d y is given 
by 

-d x + g'(y + g(x))g'(x)d y . 

This vector field always has a non-zero component in the y-direction because of 
the assumption that g' is strictly positive. 

Furthermore, the orbits of (4.1) in the absence of control stay bounded for all 
times and the corresponding diffusion process has global strong solutions and a 
smooth invariant probability measure. (The above arguments actually show that it 
has at least two distinct ergodic smooth invariant probability measures.) The miss- 
ing point in this argument of course is the fact that we have no explicit expression 
for any of these invariant measures and therefore no a priori knowledge about their 
support. 

One may argue on the other hand that it is possible to find a Hamiltonian func- 
tion H(x, y) such that d x H(x, y) = g(y+g(x)) — yp(y) and that the control system 

x = -d y H(x, y) + u{t) , y = d x H(x, y) , 

is equivalent (from the point of view taken in this paper) to (4.1), so that Assump- 
tion 1 and Assumption 3 are satisfied. This example shows that the condition that 
the level sets of H are compact is essential for Theorem 2. 1 to hold and not just a 
technical condition that ensures that exp(— g o H) can be made integrable. 

4.3 Controllability in finite time 

Let us show by a simple example that, unlike in the polynomial case studied in 
[JK85], it is not reasonable in general, under the conditions of Section 2, to expect 
the existence of a time T independent of z and A such that (1.1) can be driven from 
z to A in time T. Consider the function H(x, y) = y/1 + x 2 + y 2 and the control 
system 

x = -d y H(x, y) + u(t) , y = d x H(x, y) . (4.2) 

It is a straightforward exercise to check that all the conditions from the previous 
section are satisfied, so that Theorem 2.1 applies. 

It is equally straightforward to check that \d x H(x, y)\ < 1 for every value of x 
and y. Therefore, whatever control u is used to stir (4.2) from z = (x, y) into A, it 
will always require a time T larger than inf^'y)^ \y — y'\. 
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4.4 The Euler equations 

The three-dimensional Euler equations on the torus are given by 

it(x, t) = —(u(x, t) ■ V x )u(x, t) — Vp(x, t) , divu(x, t) = , (4.3) 

where x 6 T 3 . (Note that the algebraic condition on the divergence of u determines 
p in a unique way.) If we assume that / uq(x) dx = and expand this equation in 
Fourier modes, we obtain 

u k = ~i ( fe ' u h){ u t - iriir fc ) 

Mez 3 \{o} ' ' 

h+t=k 

subject to the algebraic conditions k • Uk = and u„fc = u^. Here, the index k 
takes values in Z 3 \ {0} (which reflects the fact that / u(x, t) dx = for all times) 
and Uk G R 3 . Furthermore, the dot • denotes the usual scalar product in R 3 . 

Since in this note we are only interested in finite-dimensional systems, we fix 
a (large) value iV* and impose Uk = for every & such that one of its components 
is larger than iV* in absolute value. 

It is a straightforward exercise to check that the total energy J2 \uk\ 2 is a con- 
served quantity for this system and that the right-hand side of (4.3) is divergence- 
free. This allows to recover immediately a weak form of the controllability results 
obtained in [Rom04, Section 6] and [AS05]. The same argument allows to show 
that the finite-dimensional Galerkin approximations for the two-dimensional Euler 
equations are controllable under the conditions presented in [HM04]. 

4.5 Non-equilibrium statistical mechanics 

The articles [EPR99a, EPR99b, EH00] considered a mechanical system coupled 
to heat baths at different temperatures Tj. This situation can be modelled by the 
following system of SDEs: 

M 

dqj = d P] H s dt - Y^{d Pj Fi)ri dt , j = 1, . . . , N , 

8=1 

AI 

d Pj = -d qj H s dt + J2id qj Fi) n dt , (4.4) 

i=l 

dn = -7^ dt + 'jiXfFiip, q) dt - ^^{Fi dwi(t) , i = 1, . . . , M , 

The interpretation of this equation is that a Hamiltonian system with N degrees of 
freedom described by Hg(p, q) is coupled to M heat baths with internal states n 
that are maintained at temperatures Tj. The functions Fi(p, q) and the constants 7, 
and Xi describe coupling between the Hamiltonian system and the zth heat bath, as 
well as the relaxation times of the heat baths. 

The control problem corresponding to this system is given by 

M 

qj = d Pj H s - Y,{d Pj Fi)ri , j = l,...,N, 

8=1 
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M 



i'j 9 qj H s ■ »V-'' ! '- 



i=l 



fi = Uiif) , 



i = l,...,M , 



which is of the form (1.1) with conserved quantity 



M 2 

H( P , q ,r) = H s (p,q) + ^2(^ 




nFiip, q) 



(Note that one could actually add any function of r to H and it would still be a 
conserved quantity.) Provided that the level sets of Hs are compact, it is easy to 
check that all of the assumptions of Section 2 are satisfied, except for Assumption 3 
which has to be checked on a case by case basis. It can for example be checked 
for the chain of anharmonic oscillators studied in the abovementioned works, pro- 
vided that the nearest-neighbour coupling potential does not contain any infinitely 
degenerate point. 

Note that if all the T, appearing in (4.4) are equal, then this equation is similar 
to (3.1) and one can check that e~ H<J3 ' q ' r ^ T dp dq dr is its invariant probability 
measure. However, the mere existence of an invariant probability measure for (4.4) 
with arbitrary temperatures is an open problem in general. (In the case of a chain 
of oscillators it was shown in [EPR99a, EHOO, RBT02] to exist, provided that the 
nearest-neighbour interaction dominates the on-site potential at high energies.) 

The controllability result shown in this article, combined with the support the- 
orem [SV72] and the smoothness of transition probabilities for (4.4) immediately 
implies the following: 

Theorem 4.1 If (4.4) satisfies Assumption 3 and the level sets of Hs are compact, 
then (4.4) can have at most one invariant probability measure. 

Proof. The conditions of Theorem 2.1 are satisfied by assumption (note that one 
can always add to H a function of r that grows sufficiently fast at infinity, thus 
ensuring that Assumption 2 holds). This immediately implies that every invariant 
probability measure for (4.4) has the whole phase space as its support. The fact 
that every invariant measure has a smooth density allows to conclude by the same 
argument used to show that the measure pu is the only invariant measure for (3.1). 
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